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HOSE who are familiar with the attempts at 

large-scale testing that have been made in 
various fields seem to agree that the physicists 
have shown unprecedented interest and cooperation 
in carrying out their particular program. From 
one point of view, this is not surprising: physicists 
are in @ particularly good position to understand 
the importance of norms as a way of expressing 
student achievement in a subject and the need for 
long-time cooperation of large numbers of indi- 
viduals tf test scales are to be made possible and 
meaningful. The traditional method of testing— 
that of a certain percentage correct of a given 
number of questions—obviously is weak, chiefly 
because different tests differ in difficulty and in 
degree of comprehensiveness so that the percentage 
correct on one is not equal to the same percentage 
correct on another. In the testing program of the 
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American Association of Physics Teachers this 
traditional method has therefore given way to the 
achievement of students in relation to one another 
as determined by a series of comprehensive, ob- 
jective tests. This change in point of view with 
regard to the testing of students has a significance 
that is quite independent of the question of whether 
these tests, or any other tests which have been 
devised thus far, are capable of evaluating all the 
possible outcomes of physics insiruciion. 

As in the case of the two previous reporis, the 
Cooperative Test Service and the Committee on 
Educational Testing of the American Council on 
Education have helped to defray the expense of 
publication. The Board of Editors of THE AMERI- 
CAN Puysics TEACHER joins with the Committee 
on Tests of the Association in expressing gratitude 
for this assistance.—THE EpITor. 


The 1935-1936 College Physics Testing Program 


HE third annual report of the Committee on 

Tests is especially significant because it 
means that for three years the American Associ- 
ation of Physics Teachers has carried on a 
democratic program in a phase of teaching that 
- heretofore has been highly individualistic. Ex- 
amining in most colleges is a departmental 
business at best, and usually it is the duty of 
each individual instructor. The fact that physi- 
cists in large numbers have collaborated in the 
program signifies that there has been a fair 
amount of agreement on core materials for 
elementary courses and that extent of learning 


measured relatively can be of practical value to 
teachers. 

Agreement on the content of the tests, arrived 
at by sampling the materials common to the 
popular textbooks, is a tribute to the uniformity 
with which physicists view the fundamentals of 
their elementary courses. Provision of a common 
scale for measuring achievement attests the fact 
that teachers recognize learning as relative. How 
a class or an individual student compares with 
classes or students in other colleges can be 
measured in no other way. What this means to 
physics teachers as a profession and to physics 
as a subject is obviously much more than was 
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Alabama 
Birmingham Southern College 
Spring Hill College 


Arizona 
Arizona State Teachers Col- 
lege, Flagstaff 
Arizona State Teachers Col- 
lege, Tempe* 
University of Arizona 


Arkansas 
Arkansas Polytechnic College* 
College of the Ozarks 
University of Arkansas 


California 

Bakersfield Junior College 

Central Junior College* 

Pacific Union College* 

Pasadena Junior College 

Pomona College* 

San Benito Junior College* 

San Bernardino Valley Junior 
College 

Southern California Junior Col- 
ege 

University of California 

University of Redlands 

Whittier College 


Colorado , 
Colorado State College of Edu- 
cation 


Connecticut 
Connecticut State College 
United States Coast Guard 
Academy 
Wesleyan University 


Delaware : 
University of Delaware 


District of Columbia 
Catholic University of America 
Washington Missionary Col- 
lege* 


Florida 
Bethune-Cookman College* 
Rollins College 
University of Florida 


Georgia 
Georgia School of Technology* 
LaGrange College 


Idaho 
University of Idaho 


Illinois 

Armour Institute of Technol- 
ogy* 

Aurora College 

Central Y. M. C. A. College 

Eastern Illinois State Teachers 
College 

Elmhurst College* 

Greenville College 

Illinois College 

James Millikin University 

Joliet Junior College 

Lake Forest College 

LaSalle-Peru-Oglesby Junior 
College 

Lincoln College 

Morton Junior College 

North Central College* 

Rosary College 

University of Chicago 

University of Illinois 

Western Illinois State Teachers 
College 

Wheaton College 
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TABLE I. Participating institutions. 


Indiana 


To 


Butler University* 

DePauw University* 

Earlham College* 

Goshen College 

Indiana State Teachers College 
Manchester College* 

Purdue University* 


wa 

Central College* 

Fort Dodge Junior College 
Graceland College 
Grinnell College 
Maquoketa Junior College 
Parsons College 

St. Ambrose College* 
Simpson College* 

William Penn College* 


Kansas 


Arkansas City Junior College* 
Bethel College* 

College of Emporia 

Friends University 

Highland College* 

Hutchinson Junior College 
Kansas State College* 

St. Benedict's College* 

Tabor College* 

University of Wichita* 


Kentucky 


Asbury College 

Berea College* 

Caney Junior College* 

Eastern Kentucky State Teach- 
ers College 

Lindsey Wilson Junior College 

Pikeville College 

University of Louisville 


Louisiana 


Louisiana State University* 


Maine 


Bates College 

Bowdoin Co!lege 

Colby College 

University of Maine 
Westbrook Junior College 


Maryland 


Morgan College* 
Western Maryland College 


Massachusetts 


Bridgewater State Teachers 
College 

Clark University* 

Mount Holyoke College 

Simmons College 

Williams College* 


Michigan 


Flint Junior College* 

Jackson Junior College* 
Kalamazoo College 

Port Huron Junior College 
University of Michigan* 
Western State Teachers College 
Ypsilanti State Normal College 


Minnesota 


College of St. Catherine 

College of St. Thomas 

Concordia College* 

Duluth Junior College 

Eveleth Junior College 

Hamline University 

Hibbing Junior College 

Itasca Junior College 

St. John’s University 

St. Mary’s College 

St. Olaf College 

State Teachers College, Man- 
kato 

Virginia Junior College 

Winona State Teachers College 


Mississippi 


Mississippi State College* 


Missouri 


Kemper Military School* 
Lindenwood College 

St. Mary’s Junior College* 
University of Missouri 
Washington University 


Montana 


Northern Montana College 


Nebraska 


Dana College* 

Doane College 

Municipal University of Omaha 
Nebraska Wesleyan University 
Union College* 

York College 


New Jersey 


Brothers College, Drew Uni- 
versity* 

New Jersey State Teachers 
College, Montclair 

St. Peter’s College 


New Mexico 


Gallup Senior High School* 
University of New Mexico* 


New York 


Alfred University* 
Bard College* 

Colgate University 
Columbia College 
Hamilton College 
Hunter College 
Niagara University 
Skidmore College 
University of Rochester 


North Carolina 


Duke University* 

Guilford College 

Western Carolina 
College* 


Teachers 


North Dakota 


Jamestown College 

Minot State Teachers College* 

North Dakota Agricultural 
College* 

North Dakota School of For- 
estry* 

University of North Dakota 


Ohio 


Baldwin Wallace College 
Defiance College 
Findlay College* 
Heidelberg College* 
Mount Union College* 


Oklahoma 


Oklahoma City University* 

Okmulgee Junior College* 

Southwestern State Teachers 
College* 

University Junior College 

University of Oklahoma 

Wetumka Junior Coilege* 


Oregon 


Linfield College 
Reed College*_ 
University of Oregon* 


Pennsylvania 


Albright College 
Allegheny College 
Bryn Mawr College 
Drexel Institute 
Geneva College 
Haverford College 
Immaculata College* 
Lafayette College 
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LaSalle College* 

Pennsylvania State College 

St. Joseph’s College 

St. Thomas College 

St. Vincent College 

State Teachers College, Cali- 
fornia* 

State Teachers College, Indiana 

State Teachers College, West 
Chester* 

Swarthmore College 

Thiel College 

University of Pennsylvania 

University of Pittsburgh, Eric 
Center 

Ursinus College 

Waynesburg College 

Wilson College 


Rhode Island 
Providence College 


South Carolina 
Clemson Agricultural College* 


South Dakota 
Huron College 
Sioux Falls College* 
University of South Dakota 


Tennessee 
Carson-Newman College* 
Lambuth College* 
Maryville College* 

Union University 


Texas 

Amarillo College* 

Brownsville Junior College 

John Tarleton § Agricultural 
College* 

Schreiner Institute* 

Texas Christian University* 

Texas Lutheran College 

University of Houston* 


Utah : 
University of Utah 


Vermont ; 7 
Green Mountain Junior Col- 
lege* 


Virginia 
Hampton Institute 
Lynchburg College 
Mary Baldwin College* 
University of Virginia 


Washington 
College of Puget Sound 
State College of Washington* 
University of Washington* 
Walla Walla College 
Whitman College* 


West Virginia : 
Concord State Teachers Col- 


lege 
Marshail College* 


Wisconsin 

Lawrence College* 

St. Norbert College 

State Teachers College, La 
Crosse ; 

State Teachers College, Mil- 
waukee* ; 

State Teachers College, River 
Falls 

State Teachers College, Su- 
perior 


Canal Zone 
Canal Zone Junior College 


Canada y . . 
St. Francis Xavier University 
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possible without a common denominator. But 
the present tests are really only a beginning and 


cannot pretend to cover all the facts for classi- 
fying students. 


Participating institutions 


The 227 participating institutions named in 
Table I are distributed throughout every state 
in the Union except three (Nevada, New Hamp- 
shire, and Wyoming) and include the District of 
Columbia, the Canal Zone, and Canada. The 
continued interest of so many institutions in the 
use of these tests indicates the fundamental 
soundness of the program and implies a high 
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standard of training among college physics 
teachers the country over. Unfortunately only 
143 institutions sent in their data in time for 
tabulation in this report, but we feel that those 
received represent a true cross section of the 
whole number. The complete list of institutions 
that ordered tests is given in Table I. Those not 


represented in any of the tables or charts are 
starreel. 


Percentile ratings 


In Tables II and III are given the data for 
computing the percentile rating of any individual 
or group of individuals taking the tests. We 


TABLE II. National percentiles for men.* 











M+H 


No. CASES 5061 3595 
MEAN ’ i“ = 32.3 41.9 


SIGMA i J 15.3 17.6 
Percentile 
100 97 
99 
98 
97 
96 
95 


94 
93 
92 
91 
90 


88 


(3) 
(3) 
2 


(2) 
(2) 
1 


0 
(0) 


M+H-+S 


L E L+E+MP 


4237 1878 
11.1 14.0 . 32.4 
5.4 3.§ 13.7 


Percentile 
100 


99 
98 
97 
96 


5 
(5) 
(5) 

4 
(4) 
(4) 
(4) 

3 
(3) 

2 
(2) 

1 


(3) 
2 
1 





* The scales are based upon returns for students tested after studying the various topics, and show true percentiles, calculated from the distri- 


butions of scores available at the time of computation. Each score in each column shows the upper score limit of the percentile indicated at the 
extreme right and left of the line. For example, the bottom entry in the column for total score on M +H shows that all scores of 4 or below have 
a percentile value of 1; all scores of 5 and 6 have a percentile value of 2; and all scores above 70 have a percentile value of 100. Since colleges used 


varying combinations of tests, the numbers of cases vary from column to column. The mean and sigma of the scores are shown at the top of each 
column. When a score appears on a scale more than once, use the figure not in parenthesis. 
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TABLE III. National percentiles for women. Because of the small numbers of cases, the percentiles are shown in abbreviated 
form. The table is to be read in the same manner as Table II. 


M+H M+H+-+S 


No. CasEes 57: : 50: 545 449 
MEAN " y “4 25.7 33.6 
SIGMA i Sz x 12.1 13.8 








Percentile 
100 69 83 

98 za 53 67 
93 2 46 56 
90 2 43 53 
5 38 47 

35 44 

33 41 

31 39 

28 35 
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375 361 19 
19.0 L 
9.9 i. 


49 59. 
43 58 
36 43 
33 40 
29 35 
27 33 
25 31 
23 30 
20 27 


Percentile 
100 
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recommend their more general use by physics 
teachers in the following ways: 

1. For early identification of the gifted student 
with relief from certain parts of the prescribed 
work, substitution of individual projects in the 
library or the laboratory, encouragement and 
more rapid advancement; 

2. For early identification of the student who 
is not physics-minded (perhaps at the outset of 
the course) so that he may be saved from 
failure; 

3. For reporting a student’s rating on a 
national, as well as a local, scale to scholarship 
committees, graduate schools, and professional 
employers; 

4. For allocation of transfer students; 

5. For testing graduate students on their re- 
tention and ability to handle the fundamentals 
of physics; 

6. For estimating the relative value of in- 
structors in the general physics course ;! 

7. For sifting of applicants for the position of 
laboratory assistant. 

Since the total score achieved in each of the 
three groups of topics usually studied in one 
semester is probably more significant than the 
score on a single topic, the data shown in columns 

1 Test scores used to rate teachers must be cautiously 
handled, however. The magnitudes of original scores and 
gains made by students obviously have no absolute mean- 
ing with reference to the ability of the instructor. They 


have meaning only in the light of course objectives and 
ability levels of students. 


6 and 11 of Tables II and III have been com- 
bined in proportion to the number of men and 
of women participants. The result for (M+H+S) 
is shown in Fig. 1; and for (L+E+MP) by the 
lowest of the three curves in Fig. 2. Thus each 
of these curves represents the distribution of 
scores for all participants in the 1935-1936 tests 
for whom results were reported on all three 
topics. 


Comparison of distribution curves 


Individual teachers, departments, groups of 
experts, and other testing agencies—all who use 
only the subjective type of question—find it 
next to impossible to devise tests that maintain 
the same level of difficulty from year to year 
and hence, with an average class, produce the 
same distribution of scores. By the use of a 
large number of questions of the objective type, 
the difficulty and the validity of which have 
been measured beforehand (see Table VI, and 
previous reports? of this committee for the 
technic required) we believe that we have been 
able to maintain our tests at the same level of 
difficulty to a degree never before achieved. 
The level of difficulty was chosen arbitrarily in 
the beginning as one such that fifty percent of 
the participants would achieve a score of 35 
to 40. 


2 Am. Phys. Teacher 2, 129 (1934); 3, 145 (1935). 


score: 
past » 
for (L 
show: 
Fig. 

terial 
be a 
numl 
for te 
were 
If the 
of th 
each 
reves 


Tabl 


Loca 
It 


curv 
with 
stan 
anot 
to ré 
nati 
We: 
of | 
nati 
class 
appe 





19335=1936 PHYSICS TESTING PROG 


40 50 60 70 80 90 100 
Percentile 


Fic. 1. Distributions of all M+-H-+S scores for 1934, 1935, 
and 1936. 


Fig. 1 shows the distribution curves for the 
scores of all participants in (M+H-+S) for the 
past three years, and Fig. 2 gives similar curves 
for (L+E+MP). The consistency of distribution 


shown in Fig. 1 is remarkable. Of the curves in 
Fig. 2 only the lowest (for 1936) departs ma- 
terially from the desired distribution. This may 
be attributed to one of two causes: either a 
number of high scores were not reported in time 
for tabulation; or the 1936 tests in (L+E+MP) 
were more difficult than they should have been. 
If the latter is the true explanation, a comparison 
of the distribution curves for the three years in 
each of the single topics L and E would doubtless 
reveal which test was too difficult. 


(Also see 
Table VII.) 


Local versus national distribution 


It is of interest to see how the distribution 
curve obtained at a single institution compares 
with the national distribution curve. Since 
standards vary so much from one college to 
another we might reasonably expect such curves 
to range from those that lie entirely above the 
national curve to those that lie entirely below it. 
We should also expect the curve for a large class 
of university students to approximate the 
national curve more closely than that of a small 
class .of college students. Such characteristics 
appear in the distribution curve that is plotted 


RAM 


3O. 0 40 
Percentile 


Fic. 2. Distributions of all L+E+MP scores for 1934, 
1935, and 1936. 


20 30 40 50 60 80 90 


Percentile ‘ 


Fic. 3. Distributions of M+H-+S (1935) scores for five 
colleges. 


in Fig. 3, together with the national curve for 
comparison. The data are taken from the 1934— 
1935 reports of one university, two arts colleges 
for men, and two arts colleges for women. 
We recommend that those in charge of ad- 
ministering these tests at each institution plot 
similar curves from their own data. Inferences 
may then be drawn at a glance with regard to 
general trend, number of high students, 
number of low students. 


and 
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Distribution of college averages 


The average percentile rating of each college 
group is given in Tables IV and V. Whereas the 
rating of any one group in any one year is without 
much significance, it must be admitted that when 
one institution maintains either a high or a low 
rating for three successive years (see previous 
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reports?) the probability is that educational 
standards in general at that institution are 
respectively high or low. In either case we 
recommend that the department of physics call 
the facts to the attention of the dean of the 
institution and make inquiry as to how repre- 
sentative of the institution the work of the 


TABLE IV. Distributions of college averages .* 


National 
Percentiles 

(Men) 
88-91 
84-87 
79-83 
72-78 
66-71 
58-65 
50-57 
42-49 
34-41 
27-33 
21-26 
16-20 
12-15 
8-11 
6-7 
4-5 
2- 3 


tw 
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Total 17 75317 
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| National 

Percentiles 
(Men) 
88-91 
84-87 
79-83 
72-78 
66-71 
58-65 
50-57 
42-49 
34-41 
27-33 
21-26 
16-20 
12-15 
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TABLE V. Distributions of college averages (continued).* 








Light | Electricity 


To-| To- 
Group 
| 

National 
Percentiles | | 
(Men) | 
99 

98 
96-97 
94-95 
92-93 
88-91 
84-87 
79-83 
72-78 
66-71 
58-65 
50-57 
42-49 
34-41 
27-33 
21-26 
16-20 
12-15 
8-11 
6-7 | 
as | 
2- 3 | 
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Modern Physics 


Light+Elec.+MP | 
To- To- To-| 


Light + Electricity 
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| 
National 
Percentile 

(Men) 

99 

98 
96-97 
94-95 
92-93 
88-91 
84-87 
79-83 
72-78 
66-71 
58-65 
50-57 
42-49 
34-41 
27-33 
21-26 
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Total j18 6 4916 5 21 115/18 55015 621 115| 7 427 8 216 64/18 54815 520111|7 426 8 214 61 








_* The means on post-study tests in all six topics and four combinations are here distributed in terms of national percentiles for men. The first six 
distributions in each topic section are for types of institutions as follows: 


1. Men's Liberal Arts Colleges 
2. Women’s Liberal Arts Colleges 
3. Coeducational Liberal Arts Colleges 


! 





4. Teachers Colleges 
5. Agricultural and Engineering Colleges 
6. Junior Colleges 


2 


9 


CHUNAR WN 


The last column in each section gives the distribution of averages for all types of institution combined. Although this distribution is based on 


sree the scale has been altered so that the intervals correspond approximately to a sigma scale. The vertical distances are therefore roughly 
comparable. 
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TABLE VI. Difficulty and validity indices for each item in the M, H, S, L, E, and MP, 1936 B test forms. 





Mechanics Heat Sound Light Electricity Mod. Phys. 
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students in physics is. We believe that the TABLE VII. Summary of difficulty and validity indices. 


foregoing results may be attributed in large joi) ee ame 
measure to the standards of admission in force — 

at each institution. In general these are apt to 
be too low; but they may be too high. If too low, 
many may be admitted who are incapable of 
carrying work of college grade; if too high, 
many may be rejected who are well rounded 
and able but immature and of slow development. 


Difficulty and validity 


Table VII presents a summary of the difficulty 
and validity indices shown for each item of the 
1936B tests in Table VI. The techniques em- 
ployed in determining these indices have already 
been described in our 1933-1934 report. 

It may be seen that in the case of the first- 
semester topics half of the items were answered 
correctly by at least 50 percent of the students 
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(difficulty =50 or more), but in the case of the 
second semester topics half the items were an- 
swered correctly by only 40 ‘percent of the 
students (difficulty =40 or more). Here is addi- 
tional proof that the second semester (1936B) 
tests were too difficult. Furthermore, the chief 
offender would appear to be the test on elec- 
tricity, since only one item was answered cor- 
rectly by as many as 75 percent of the students, 
and only 15 out of 44 items were answered cor- 
rectly by as many as 50 percent. 


Natl. 

men's 

o file 
76 100 
74 99 
72 99 
70 98 
68 96 
66 94 
64 92 
62 88 
60 864 
s8 79 
56 73 
54 66 
52 58 
50 50 
48 42 
46 34 
44 27 
42 21 


40 16 


Coll. No. 1 4 6 


College distribution 


The striking differences in average achieve- 
ment of different college groups together with 
the wide “spread,’’ high score to low score, 
within each group, noted in our earlier reports, 
appears again as set forth in Figs. 4 and 5. The 
fifteen colleges were chosen by our statistician so 
as to emphasize the extent of this range in 
achievement; the identity of the colleges is 
unknown to this committee. 

A glance at Figs. 4 and 5 shows at once that 


38 12 
356 
54 
52 
50 
28 
26 


g ¢ QO ii 12 13 14 15 


Fic. 4. Variability of achievement as measured by the combined scores on M, H, and S. The middle horizontal line 
shows the national median and the other two lines are at the 16th and 84th percentiles of the national distribution. Each 
of the bars represents an individual college. The wide portion of each bar represents the range of scores of the middle 
half in each college. The narrow parts extend to the 16th and 84th percentiles in each college, i.e., one standard deviation 
above and one below the mean. The lines at the ends extend down to the 10th percentile and up to the 90th percentile. 
The crosses below the bars represent the lowest scores and those above, the highest scores in the several colleges (the 
range). The short cross-line at the middle of each bar represents the median score of the college. Although this chart is 
based entirely on percentiles, the scale has been altered roughly to a sigma scale, so that vertical distances are approxi- 


mately comparable. The sigma scale is derived from the percentile scale. The bars represent both men and women 
students, but the percentile scale is that for men students from Table IT. 
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colleges 2, 3 and 4 ranked high in both semesters, 
whereas colleges 10-15 ranked low. Among the 
remaining six colleges less consistency is shown. 
While we admit that conditions at colleges 2-5, 
and others in their class, are doubtless such as 
to foster the production of good student work in 
physics we, nevertheless, wish to warn these 
colleges against the danger of attaching too much 
significance to the achievements of their students 
on our 1936 tests. At the same time it is desirable 
to encourage colleges 10-15, and others in their 
class, to work for greater achievement on the 
part of their students through the various well- 
known methods of improving standards and 
teaching conditions. It may well be that at 
such colleges the importance of physics is as 
yet not well recognized, and hence that the 


Natl. 
men's 
o hile 
76 100 


74 99 
72 99 
70 98 
68 96 
66 94 
€4 92 
62 88 
60 84 
58 79 
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departments of physics are working under handi- 
caps. The object of our testing program is not 
only to discover factors which are involved in 
success of physics teaching all over the coun- 
try, but also to assist in the raising of the 
standards of such teaching. We have made the 
foregoing criticisms with this viewpoint in mind. 
At any rate, we can all take heart from Figs. 4 
and 5 to the extent that the differences in 
achievement there set forth are not peculiar to 
physics. Similar differences have been found in 
every other department as the result of studies 
made in both schools and colleges. 


Professional goal groups 


The numbers of students of architecture, 
agriculture and law represented in Fig. 6 are so 


IG. 5. Variability of achievement as measured by combined scores on L, E, and MP. To be read in the same manner 
as Fig. 4. 
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small that no significance can be attached to 
the trends of the curves. The curves for the pre- 
teachers and the premedical students run 
almost parallel, about halfway between those for 
the engineers, above, and for the business 
students, below. In these days when the im- 
portance of industrial research is so often set 
before the public, we believe that those who are 
anticipating a business career should more fully 
appreciate the necessity of studying physics, 
and should show their appreciation of its value 
by achieving a firmer grasp of its fundamentals 
than Fig. 6 indicates is the present practice. 

Again and again members of this committee 
have had the experience of receiving calls from 
returning alumni who have gone into business, 
and who express to us with enthusiasm, albeit 
with sonre surprise, that the course in physics 
Natl. 
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Fic. 6. Averages of professional goal groups. The data are graphed in terms of the national percentile scale for men, 
altered, as in Fig. 4, to conform approximately to the sigma scale. Vertical distances are, therefore, roug hly comparable. 


has been of more benefit to them in business 
than any other of their college courses. This 
statement holds true for alumni who were poor 
students of physics as well as for those who were 
good students. We urge our fellow physicists to 
help in spreading this information, and we feel 
confident that there will result a greater apprecia- 
tion of physics by the business groups, with a 
consequent improvement in their achievement. 


Gain in achievement 


This year a study has been made of the gain 
in achievement shown by students who had 
studied physics in secondary school and by those 
who had not. The results are set forth in Figs. 7 
and 8. The pre-tests and post-tests used in this 
study were made as nearly comparable as 
possible by selecting pairs of questions of known 
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Fic. 7. Pre- and post-study comparisons for M, H, and S. The two bars at the left of each section represent distributions 
of scores for all students who had not studied physics in high school and who took the tests both before and after study. 
The two following bars represent the distributions of pre- and post-test scores for students who had studied physics in 


high school. 


difficulty and validity (technique described in 
1933-1934 report”). Hence the tests should have 
been more nearly comparable than were the post- 
tests from year to year as shown in Figs. 1 
and 2. 

There are two prevalent views among physics 
teachers with regard to the value of the study of 
this subject for one year in secondary school. 
Some teachers argue, ‘When they come to me 
those who have studied physics in school know no 
more than those who have not; hence I treat 
them all alike.’’ Others aver, ‘‘Except for students 
of exceptional ability, the college course in 
general physics is too hard for students who have 
never studied the subject in school; hence I 
admit to this course only those who have already 
studied the subject for at least one year.” 


The problem is a difficult one, for in the first 
case the teacher must start at the zero level, 
thereby permitting those students who already 
know something to acquire slovenly habits, and 
in the second case injusticé may be*done to 
some who are refused admission to the course in 
spite of having the requisite ability and willing- 
ness to work hard. 

It is regrettable that the number of cases 
supplying data for Figs. 7 and 8 is small. Yet if 
we may assume that these represent a fairly 
accurate sampling, we find that in all but one of 
the ten topics, im both pre-tests and post-iesis, 
the students who had studied physics in school 
scored higher than those who had not. The 
exception appears in modern physics—a subject 
to which, up to the present, it has been possible 
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Fic. 8. Pre- and post-study comparisons for L, E, and MP. To be read in the same manner as Fig. 7. 


to devote very little time in secondary school, 
hence both groups of students here ‘‘started from 
scratch.”’ 

A more rapid comparison of the results of this 
study may be made from Fig. 9, in which have 
been plotted the average scores achieved by each 
group on both pre-tests and post-tests. The re- 
markable feature of this graph is that it tends to 
substantiate both of the apparently opposite 
views held by physics teachers. The first group 
of teachers stresses the fact shown by the pre- 
test curves, namely that at the siart those who 
have previously studied physics show little more 
knowledge (except in the first semester topics) 
than those who have not; whereas the second 
group of teachers have in mind the fact shown 
by the post-test curves, namely that the ultimate 
achievement of those students who have had 


physics before is greatly superior to that shown 
by those who have studied none. A possible 
reason for this notable difference is that as the 
student who has studied physics before pro- 
gresses, his previous work is recalled to mind and 
his memory refreshed, with the net result that 
the college work comes to him much more 
easily than to the student to whom everything 
is new. 

The committee regards this study as an im- 
portant contribution to the solution of a difficult 
pedagogic problem, and hence strongly urges 
all teachers who can spare the time for the 
administration of pre-tests to supply further 
data for its continuation. 


Correlation 


In previous reports of this committee very 
little has been published with regard to corre- 
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Fic. 9. Averages on pre- and post-tests of students who 
had studied physics in high school and students who had 
not studied physics in high school. 


lations which may exist between either pre- 
test and post-test scores, or between post-test 
scores and class or semester marks. The small 
amount of sampling which has been done has 
shown a rather unexpectedly high degree of cor- 
relation—in each of the above cases about 0.75. 
While it would be of interest to test such corre- 
lations through more reliable sampling of the 
data in hand, such a procedure is not possible 
this year. Hence the committee should like to 
point out a way in which interesting information 
of this character can be obtained by each teacher 
from the data supplied from his own class. 

In Fig. 10 are drawn three broken lines that 
represent the actual scores (not percentiles) 
achieved by each member of a class of 32 in a 
college for women on the 1936 (M+H-+S) pre- 
tests, post-tests, and class grade averages. Each 
student is given a number from 1 to 32 and her 
score appears on a vertical line drawn through 
her number at the bottom of the graph. The ups 
and downs of the lower pair of curves may be 
compared by inspection, and similarly for the 
upper pair. In many cases peaks correspond to 
peaks, and depressions to depressions, which 
seems to indicate there may be some degree of 
correlation even between pre-tests and class 
averages. 

Fig. 11 is a similar graph for a class of 37 at a 
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Fic. 10. Class grade averages and M+H-+S (1936) pre-test 


and post-test scores of 32 students. 


college for men. Unfortunately some students 
missed the pre-test, hence this line is incomplete. 
The data were taken from the 1935 pre-tests in 
(M+H-+S). The same general similarities ap- 
pear as in Fig. 10. However, even if we were able 
to prove the existence of a much higher degree 
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Fic. 11. Comparison of M+H-+S (1935) pre-test and post- 
test scores with semester averages for 37 students. 
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of correlation than is ever likely to be possible, 
we must remember that the problem is really a 
statistical one, and each individual case will 
always depart more or less from the general rule. 

In conclusion we offer our thanks to each de- 
partment and teacher collaborating in the testing 
program. Without the splendid support that 
physicists have lent by using the tests, criticizing 
them, and suggesting improvements, and by 
making studies on how the results can best serve 
teachers, the committee could not possibly 
carry on. Credit for the program and the enviable 
reputation it is gaining among other departments 
are in largest measure due to the members of the 
Association. In this cooperative venture they are 


COMMITTEE ON 


TESTS 


in the vanguard of those who conceive of educa- 
tion as an orderly, measurable process that 
develops the individual to his fullest capacity 
and at the same time enables a science or a 


profession to take advantage of the best talent 
available. 


The Committee on Tests of the American 
Association of Physics Teachers 
H. W. FARWELL, 
C. J. Lapp, Chairman, 
Harvey B. LEmon, 
FREDERIC PALMER, JR., 
Joun T. TATE, 
A. G. WorTHING. 


Onppers for the Cooperative Physics Tests for 
College Students should be directed to the Co- 
operative Test Service, 437 West 59th Street, 
New York City. Pre-study tests for the current 
year will be labeled Form 1937A; post-study 
tests, Form 1937B. 


The American Physics Teacher is published quarterly for the American Association of Physics Teachers by the 
American Institute of Physics, 175 Fifth Avenue, New York, N. Y. 





